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Abstract. In this paper I give a brief introduction to a family of simple but non- 
trivial models designed to increase our understanding of collective processes in markets, 
the so-called Minority Games, and their non-equilibrium statistical mathematical 
analysis. Since the most commonly studied members of this family define disordered 
stochastic processes without detailed balance, the canonical technique for finding exact 
solutions is found to be generating functional analysis a la De Dominicis, as originally 
developed in the spin-glass community. 
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1. Introduction 

The Minority Game (MG) [ffj, a variation on the so-called El-Farol bar problem 0, was 
designed to understand the cooperative phenomena observed in markets. It describes 
agents who each make a binary decision at every point in time, e.g. whether to buy or 
sell. Profit is made by those who find themselves in the minority group, i.e. who end 
up buying when most wish to sell, or vice versa. The agents take their decisions on the 
basis of an arsenal of individual 'strategies', from which each agent aims to select the 
optimal one (i.e. the strategy that leads to the largest number of minority decisions). 
The dynamic equations of the MG describe the stochastic evolution of these strategy 
selections. Each agent wishes to make profit, but the net effect of his/her trading actions 
is defined fully in terms of (or relative to) the actions taken by the other agents. Hence 
the model has a significant amount of built-in frustration. Although in its simplest form 
(as discussed in this paper) the MG is a crude simplification of real markets, there is 
now also a growing number of more realistic MG spin-off models || . 

For the non-equilibrium statistical mechanicist the MG is an intriguing disordered 
system. It has been found to exhibit non-trivial behaviour, e.g. dynamical phase 
transitions separating an ergodic from a highly non-ergodic regime, and to pose a 
considerable mathematical challenge. Its stochastic equations do not obey detailed 
balance, so there is no equilibrium state and understanding the model requires solving 
its dynamics. In this paper I first give an introduction to the properties and the early 
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studies of the MG, seen through the eyes of a non-equilibrium statistical mechanicist. 
The second part of the paper is a review of the more recent applications to the MG of 
the generating functional analysis methods of De Dominicis |4|] . These have led to exact 
results in the form of closed macroscopic order parameter equations, and to clarification 
of a number of unresolved issues and debates regarding the nature of the microscopic 
laws and various previously proposed approximations. 

2. Definitions and properties 

We consider a community of iV agents, labeled i = 1...N (the 'market'). At each 
discrete iteration step £ each agent % must take a binary decision Si(£) G {—1, 1} (e.g. 
'sell' or 'buy'). The agents make these decisions on the basis of public information I(£) 
which they are given at stage £ (state of the market, political developments, weather 
forecasts, etc), which is taken from some finite discrete set Q = {Ii,...,I p } of size 

= p. For future convenience we will also define the relative size a = p/N. Note 
that all agents always receive the same information. Profit is made at iteration step £ 
by those agents who find themselves in the minority group (by those who wish to buy 
when most aim to sell, or vice versa), i.e. by those i for which Si(£)[J2j Sj(£)] < 0. 

The actual conversion of the observation of I{£) into the iV trading decisions 
{si(^), • • • , sn(£)} is defined via so-called trading 'strategies', which are basically look-up 
tables. Every agent i has S decision making strategies Rj a = (R} a , ■ ■ ■ , R p io ) G { — 1, 
with a G {1, . . . , S}. If strategy a is the one used by agent i at iteration step £, and 
the public information I(£) is found to be I(£) = I^e), then agent i will locate the 
appropriate entry in the table Tt ia and take the decision 

Si(i) = B& ti (1) 

Thus, given knowledge of the active strategies of all N agents, the responses of all agents 
to the arrival of public information are fully deterministic. 

What remains in defining the model is giving a recipe for deciding the choice of 
decision strategy Rj a from the arsenal of S possibilities as a function of time, for all 
agents. This is done as follows. The agents aim to select or discover profitable strategies 
within their arsenals, by keeping track of the strategies' performance in the market. A 
strategy Rj a is profitable for agent i at stage £ of the game (i.e. it puts agent i in the 
minority group) if and only if i£f a — ~ sgn[X)j Sj(£)]. Hence we can measure for each 
agent i the cumulative performance of strategy R ia by a quantity p ia , which is updated 
at every stage £ of the game according to 

p t a(£+i)=pUt)-jjR^Y.^) (2) 

j 

with i] > (the scaling factor N is introduced for future mathematical convenience). 
Each agent i now chooses at every stage £ of the game the strategy which has the 
best cumulative performance Pi a {£) at that point in time. 

In summary, upon insertion of (fj) into @ and given the external information stream 
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Figure 1. Dependence of the volatility a on the re-scaled size a — p/N of the external 
information set £1. The markers refer to numerical simulations following different initial 
conditions (whose details will be explained later), with S = 2 (two strategies per agent) 
and N = 4000. The value a — 1 would have been obtained for purely random decision 
making. 

defined by {/i(£)}, the dynamics of the MG is defined fully by the following two coupled 
non-linear equations for the evolving strategy performance measures {pi a } (with A(£) 
giving the total market bid at stage £): 

Pia (i + 1) = Pia (£) - ^R^A(l) A(£) = £ (3) 

j 

Oi(£) = arg max a6{lj ... jS} p ia (£) (4) 

In the original model [I] the information [/,(£) was defined as a deterministic function 
of the macroscopic market history, i.e. of the terms A(£') = J2jSj(£') = YljR a .w) with 
£' < £: //(£) = K[A(£ - 1), A(£ - 2), . . .], for some function K[. . .]. In this formulation 
the process is fully deterministic but non-local in time. Furthermore, there is 

quenched disorder (the realization of the look-up tables {Ri}) and a large degree of 
built-in competition and frustration. 

The main quantity of interest to those caring about real markets is the so-called 
volatility, the measure of macroscopic market fluctuations. In the present model the 
appropriate object is the re-scaled and time-averaged variance a 2 of the total bid A(£) 
(since the time-averaged expectation value of the total bid is zero): 

a 2 = lim -\-j^A 2 {£) (5) 

This quantity was found in simulations to depend in a nontrivial way on the relative 
size a of the set fl, similar to e.g. Figure [l], which seemed to suggest to agents the 
possibility of market prediction (since random decision making corresponds to a = 1) 
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and to theorists the presence of a non-equilibrium phase transition. Since simulations 
also indicated that the behaviour of the volatility did not depend qualitatively on the 
value of S (the number of strategies per agent, provided this number remains finite as 
iV — > oo), most of the research has concentrated on the simplest nontrivial case S = 2. 
Here it is possible to reduce the dimensionality of the problem further upon defining 

_ Pa - Pi2 ptk _ iffi - gjg o _ gjjjffi + ^2] (R , 
qi ~ 2 ' * ~ 2 ' 2VN [) 



We can now write the process in the deceivingly compact form 

+ 1) = M - ^= Cf W ^) + ^ E (7) 

which in the standard MG is non-local in time due to the dependence of fi(£) = 
K[A(£ -l),A(£-2),...] (with A(£') = £j sgnfo (€')]) on the past of the system. 

3. Early studies and generalizations 

The first major step forward after the MG's introduction in |lj was ||, where it was 
shown that the volatility a remains largely unchanged if, instead of being calculated 
from the true market history, the variables \x{€) are simply drawn at random from 
{1, . . . ,aN} (at every iteration step £, independently and with equal probabilities). 
Apparently the agents are not predicting the market: the observed phenomena are the 
result of complex collective processes, which depend only on all agents responding to 
the same information (whether correct or nonsensical). The mathematical consequences 
of having the numbers drawn at random, however, are profound: the equations (0) 
now describe a disordered Markov process (without detailed balance) and analysis comes 
within reach. In || it was shown that the relevant quantities studied in the MG can be 
scaled such that they become independent of the number of agents N when this number 
becomes very large. An interesting generalization of the game was the introduction of 
agents' decision noise J7|, which was shown not only to improve worse than random 
behaviour but also, more surprisingly, to be able to make it better than random||[ In 
Til one finds the first observation in the MG of the so-called 'frozen agents'. These 



are agents for which asymptotically ~ £ {£ — > 00), in the language of (|7|), and 
who in view of the definition qi = \ [pn — Pi-i\ will eventually end up always playing the 
same strategy. The four papers 0, §, |7|, [LCj more or less paved the way for statistical 
mechanical theory. 

The first attempt at solution of the MG is found in |TTJ, [12|], whose authors studied 
the MG with decision noise and argued that for N — > 00, and after appropriate 
temporal course-graining, one is allowed to neglect the fluctuations in sgn[gj(£) + Zi(£)] 
and concentrate on the expectation values mi(£) = Jdz P(z)sgn[qi(£) + z]. In terms 
of the re-scaled time t = £/N the authors then derived deterministic equations in 

I Using a phenomenological theory for the volatility, based on so-called 'crowd-anticrowd' cancellations 
this effect was partially explained in [N, pj. 
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the limit iV — > oo, of the form dmi(t)/dt = /j[m(t)], which were shown to have a 
Lyapunov function. This allowed for a ground state analysis using equilibrium statistical 
mechanics, in combination with standard replica theory [[U| to carry out the disorder 
average (based on the introduction of a fictitious temperature which is sent to zero after 
having taken the limits N — ► oo and n — » 0, where n denotes the replica dimension, 
similar to e.g. [0). The authors of O, O found a phase transition at a j a c ~ 0.33740 
(in agreement with simulation evidence, see e.g. Figure |l|), but ran into mathematical 
difficulties for a < a r - 



The authors of 0, [12[ then initiated a discussion [15], [16| about the validity of the 
assumptions in [11, [12| and the reliability of the simulations in f7|. Following a further 
study fl~7 |, in which a Fokker-Planck equation was derived for the MG (and solved 
numerically), and where fluctuations were claimed not to be negligible, this discussion 
appeared to be put to rest in |L8| with the conclusions that the simulations of had not 
yet equilibrated (acknowledged already in [0]), and that the microscopic fluctuations 
in the MG can not be neglected after all (except perhaps in special cases). It should 
be noted, however, that the microscopic definitions of |7], [R| [T7j are different from 
those of fTl , 15 , |T8|| . This state of affairs was unsatisfactory: there was still no exact 
solution of the MG (whether for statics or dynamics), the status of the assumptions and 
approximations made by the various authors remained unclear, in both []I7 and [ |TS| 



Fokker-Planck equations are derived for the MG, but with different diffusion matrices, 
and (finally) there were conflicting statements on the differences between multiplicative 
and additive decision noise with regard to the volatility. Clearly, since the MG defines a 
disordered stochastic process without detailed balance, the natural analytical approach 
is to study its dynamics. In the remainder of this paper I show how the generating 
functional techniques developed by De Dominicis [Q can be used to solve various versions 
of the MG analytically. Full details of this analysis can be found in the trio [O, 20, 21 



4. Solution of the Batch MG 



In order to circumvent the debates relating to the temporal course graining of the MG 
process and concentrate fully on the disorder, the first generating functional analysis 



study of the MG |19| was carried out for a modified so-called 'batch' version of the 
model. Instead of the equations (0) (where state changes follow each randomly drawn 
information index /i(£)), in the batch MG the dynamics is defined directly in terms of 
an average over all possible choices ^ G {!,..., aN} for the external information: 



aN 



(8) 



Here we have also chosen rj = y~N (to ensure O(N ) characteristic time-scales for 
the batch version of the MG). This defines a disordered deterministic map, since the 
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stochasticity has now been removed. An external force 9i{£) was added in order to define 
response functions later. 

Generating functional analysis a la De Dominicis [f|] is based on evaluation of the 
following disorder-averaged|| generating functional: 



Z[iJ>] = /e^IUE^o (9) 

From this object one can obtain the main disorder-averaged quantities of interest, such 
as individual averages, multiple-time covariances, and response functions, e.g. 



idZ [xjj] 



<*w>=£bw (10) 



d 2 Z [ip] 



= lim jg£M (12) 

One next defines suitable (time-dependent) fields which must depend linearly on an 
extensive number of the statistically independent disorder variables {-Rf a }, and which 
drive the dynamics (in spin-glass models these would have been the actual local magnetic 
fields), such as x^(£) = y2/NJ2i s g n fe(^)]£f ■ O ne then writes (|) as a sum (or integral) 
over all possible paths taken by these fields. In practice this is done via the insertion 
into (|9|) of integrals over appropriate ^-distributions, e.g. of 




^)-^E s e n fe(« 



(13) 



This procedure is carried out until all disorder variables have been concentrated into 
such fields; here this requires further fields in addition to the x^{€). Upon writing the 8- 
functions in expressions such as (|13|) in integral form, the independent disorder variables 
{Ri a } will all occur linearly in exponents, so that the disorder average can be carried 
out. At the end one finds an expression involving an integral over all possible values of 
the single-site correlation and response functions 

1 N 



C* =^E(sgnfeW]sgn[ gi (t')]} (14) 

i=l 

i " a 



^ = j?£ MM <*"[*(«>]> (15) 

and a further set of related order parameter kernels {C tt >, G t t>, L u >, L u >}: 

~Z\4>\ = J VCVCVGVGVLVL e N *lc,c,G,G,L,L] ^ 

§ Disorder averaging will be denoted as [...]. The disorder is in the variables £f and Q^, see the 
definitions (H), with /i G {1, ...,aN} and with each of the 2aN 2 strategy table entries Rf a drawn 
independently at random from {—1,1} with equal probabilities. 
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Figure 2. The persistent covariance c = lim^oo C(t) (left picture) and the fraction 4> 
of frozen agents (right picture) in the stationary state. The markers are obtained from 
individual simulation runs, with N = 4000 and various homogeneous initial conditions 
(where <?i(0) = q(0) Vi), measured after 1000 iteration steps. The solid curves to 
the right of the critical point (vertical dashed line in each picture) are the theoretical 
predictions, given by the solution of (|2^j2^) . The dotted curves to the left of the critical 
point are their continuations into the a < a c regime (where they should no longer be 
correct). 



with the abbreviation DC = Utt'>o dC tt >, and with *[...] = O(N ). In the limit iV -> oo 
the integral in (|16|) is evaluated by steepest descent, giving closed dynamical equations 
for the kernels {C, C, G, G, L, L}, from which {C, G, L, L} can be eliminated. This 
leaves a theory described by closed equations for C and G only, which turns out to 
describe an effective stochastic 'single agent' process of the form 

q(t + 1) = q(t) + 6{t) -a^[I+ G] u } sgn[g(f )] + v(t) (17) 

f<t 

In ( P77| ) one has a retarded self-interaction and a zero-average Gaussian noise T](t) with 

( V (t) v (t>)) = [(I + GO-^Cl + Gt)" 1 ]^ D tt , = l + C tt , (18) 

The equations from which to solve the two kernels {C, G} self-consistently are defined 
in terms of the non-Markovian single-agent process (|l7|Jl8|) as follows: for all t, t' G IN 

C tt , = (8gn[g(t)]8gn[g(0]>, G w = ^(sgn[g(t)]} (19) 

Finding the general solution of ([19|) analytically is extremely hard; one has to restrict 
oneself in practice to working out the first few time steps, to stationary solutions, or to 
numerical solution. 

If, for instance, one investigates asymptotic stationary solutions of the form 
Cu' — C(t — t') and G tt > = G(t — t'), and furthermore assumes absence of anomalous 
response (i.e. a finite value for the integrated response x — J2t>o C(t)) it is not difficult 
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Figure 3. Evidence for the existence of a critical initial strategy valuation q c (0) below 
which a high- volatility solution a ~ a -1 / 2 (a — ► 0) exists. Connected markers show the 
results of individual simulations, with N = 4000 and homogeneous initial conditions 
<7i(0) = q(Q) Vi, measured after 1000 iteration steps. The data are compatible with the 
prediction q c (0) w 0.242 (dashed line). 



I9fl to obtain an exact closed equation for the persistent correlation c 



erf 



a 



a 



'2(1 + c 



-e 2 ( 1 + c ) , 



lim^ooC^): 

2(l + c) " - - - <20) 
from which c follows as a function of the parameter a. Similarly one can find exact 
expressions for the fraction of 'frozen' agents and for the integrated response x- 

(21) 

\ = ( I - o)/(n - I o) (22) 



1 - ed[yja/2(l + c)] 
(l-0)/(a-l + 0) 



For a — >• oo one finds lim r 



lim n 



lim r 



X 



0. 



It follows from (P2j) 

that the assumption \ < oo underlying (|20| , |2T1J2^) breaks down when a = 1 — <fi. This 
defines a critical value a c signaling the onset of non-ergodicity, which can be calculated 
in combination with (21) , giving a c ~ 0.33740 (the same value obtained earlier in 
. The results of solving (]20f) and (pl|) numerically, as a function of a, are shown 
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in Figure [| One observes perfect agreement with simulations for a > a c , and, as 
expected, disagreement and ergodicity breaking for a < a c (where the condition x < oo 
is violated). The volatility is found not to be a natural order parameter of the MG (nor 
expressible directly in terms of the solution of ( j2T|[2~l~D , not even for a > a c ; its calculation 
required approximations, resulting in Figure [I] (shown together with simulation results 
of the same specifications as those in Figure 0). 

It should be emphasized that for a < a c the macroscopic equations ([I^.|18].[n]) 
are still exact; finding their stationary solutions analytically, however, is much more 
difficult. Some of the results which have been obtained for the a < a c regime, for 
instance, are scaling properties of solutions for a — > (shown in Figure [l]). Low 
volatility solutions a ~ ah [a — > 0) are found following initial conditions with large 
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|<7i(0)|, whereas high- volatility solutions with a ~ or\ [a — > 0) are found following 
initial conditions with small |<7i(0)|. Upon making some simple approximations one can 
also calculate an expression for the critical initial value for the |<7i(0)|, q c {0) ~ 0.242, 
bordering the region of existence of the high-volatility solution, see Figure [| 




5. Solution of the Batch MG with decision noise 

The Batch MG with decision noise is obtained upon making in @ the replacement 
sgn [<&(£)] — > a[qi(£), Zi(£)\Ti], with the {zi(£)} representing zero-average and unit- 
variance identically distributed and independent random variables. The parameters 
Tj > measure the noise levels of the individual agents. The function a[. . . \T] obeys 
a[q, z\T] G { — 1, 1}, cr[q, z\0] = sgn[g] (for T — > we return to the previous model) and 
Jdz P(z)cr[q, z\oo] = (T — ► oo implies purely random decisions). Examples are 

additive noise : a[q,z\T] = sgn[g + Tz] (23) 

multiplicative noise : a[q, z\T] — sgn[q] sgn[l + Tz] (24) 

The deterministic equations (H) are thus replaced by the following stochastic ones: 

1 aN i 1 

q,(( + 1) = M - ^ E & K + ^Eff ° few, * 

(25) 

The analytical procedure outlined for the previous model (|Sp is adapted quite easily 
to its generalization (pop. Again one finds, in the limit iV — > oo, closed equations for 
the disorder-averaged correlation and response functions (|b|,|l^), describing an effective 
stochastic 'single agent' process: 

q(t + 1) = q(t) + 9{t) - a £[I + G] a }a[q(t'), z(t')\T] + ^ T](t) 

t'<t 

(26) 

(parametrized by a noise strength T, so that we must denote averages henceforth as 
(. . .)r). The covariances of the zero-average Gaussian noise rj(t) are still given by flllf) ; 
the independent random variables {z(t)} are distributed exactly as the site- variables 
{zi(£)} in (p5|) . The order parameter equations (|19D are now found to be replaced by 

C tt , = / dT W(T) (sgn[q(t)]sgn[q(t')]) T (27) 
Jo 

Gu> = fdT W{T) ^ (sgn[g(t)]) T (28) 

with the distribution of noise strengths 

1 N 

W(T)= hm ^E^-^] (29) 

Making the choice W(T) = 5(T) (i.e. deterministic decision making) immediately brings 
us back to (|!7|Jl8|Jl9|) , as it should. 
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Figure 4. Transition lines for the Batch MG with multiplicative decision noise 
©, P(z) = (2 7 r)- 1 / 2 e- z2 / 2 , and W(T') = eS[T' — T] + (1 — e)<5[T'] with e e 
{0,0.2,0.4,0.6,0.8,1} (from right to left). Each line is defined by the condition 
X = X)t>o = 00 an< l separates a non-ergodic phase (to the left) from an ergodic 
phase (to the right). For additive noise our theory predicts the T-independent (vertical) 
line, i.e. the e = curve, for any choice of W(T). 



In the present model one can as before calculate stationary solutions without 
anomalous response, and calculate order parameters such as c and as a function of a 
and the distribution W(T), and for different types of decision noise. A phase transition 
to a highly non-ergodic state will again be marked by \ = Y<t>o G{P) = 00 • Here I restrict 
myself to showing phase diagrams for some simple choices, see Figure f|. The theory 
reveals that, in the ergodic regime, for additive decision noise (|2lf ) the location of the 
X = oo transition is completely independent of W(T)U the same is true for the values 
of the order parameters c and 0. Calculating the solution of equations (BE|TRp7],E3) 



for the first few time-steps [|ZD| also reveals the mechanism of how the introduction of 
decision noise can indeed have the counter-intuitive effect (observed already in 0) of 
reducing the market volatility a, by damping global oscillations. 



6. Solution of the On-line Minority Game 

Having carried out the generating functional analysis of the two previous batch versions 
of the MG (with S = 2, and with deterministic or noisy decision making), the obviouys 
next step is to return to the original (more complicated) dynamics (0) where state 
changes followed individual presentations of external information, but now generalized 

|| The explanation for this seems to be that the x = 00 transition is determined purely by the properties 
of the 'frozen agents'. These agents, for which qi(£) ~ £ as £ — ► oo will asymtotically always overrule 
the noise term in (^). In contrast, for multiplicative noise (j|J) the noise will retain the potential to 
change decisions, even for 'frozen' agents. 
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to include decision noise: 



V Mi) 



qi(£ + l) = qi 



(30) 

The n(£) are drawn randomly and independently from {1, . . . , aN}, introducing a second 
element of stochasticity on top of the decision making noise variables {zj(£)}. However, 
the individual (noisy) updates are now small (0(N~^), so for iV — ► oo we may attempt 
a continuous-time description. This switch to continuous time (in particular: whether 
upon doing so the fluctuations can be taken as Gaussian, or even be discarged) was the 
subject of the discussion in |TS], |Tj| and subsequent papers. 

The temporal regularization problem can be resolved using a procedure described 
The idea is to link the process 



in 



22 



(J) to a continuous time one by defining random 



durations for each of the iterations in (|30|) , distributed according to 



Prob 



steps at time t £ IR^ 



1 


■ t ' 







-t/A N 



The parameter An gives the average real-time duration of a single iteration of (J3QQ . 
Upon writing the Markov process (|30|) in probabilistic formal 

(31) 



p<+i(q) = / w(qlq')Mq') 

we find the new continuous-time process to be defined as 

d , . 1 



dt Pt[q) 



A 



dq' W(q|q')p t (q')-P*(q) 



(32) 



The price paid is uncertainty about where one is on the time axis. This uncertainty, 
however, will vanish if we choose A^r — » for iV — > oo. Upon studying the scaling 
properties with N of the process (^) via the Kramers-Moyal expansion, for the kernel 
W(q|q') corresponding to (|30"D, one can establish the following facts: 

• The correct scaling for the parameters A^r and rj is: Ajy = O^N^ 1 ), 77 = O(N ) 

• As N — > oo one obtains a Fokker-Planck equation for individual components qf. 

j t PMi) = ^ IpMFiiq^t)} + [pMi)D l {q l ,t)} + 0(-^=) 

• The process for q = (q 1 , . . . , q^), however, cannot for N — > oo be described by 
a Fokker-Planck equation (non-Gaussian fluctuations in the q^ cannot a priori be 
discarged; although small, they might conspire for an iV-component system). 

Working out the diffusion matrix Dy(q) of the full process, for additive decision noise 
(p3|) , for comparison with previous results in [17j and Jl8| (where the MG was claimed 
to obey a Fokker-Planck equation), reveals that -Djj(q) = D^(q) + D?(q), where 

l 2 



N 



Em 



/x=l 



E^tanh^- 



(33) 



% We leave aside the external fields for now, which only serve to define response functions. 
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DfM) 



fi\2 



tanh 2 (/%) 



(34) 



The term -D^(q) mainly describes fluctuations due to the randomly drawn indices fJ>(£); 
DfAc\) reflects mainly the fluctuations generated by decision noise. Comparison shows 
that the diffusion matrices given in |17] and |L8] are both approximations. 

Having resolved the temporal regularization, one can now proceed to analyze 
the MG upon adapting to continuous time each of the generating functional analysis 
steps taken for the batch MG models (upon adding external fields). Since we choose 
Aat = 0(N^ 1 ) the impact of studying ( |32|) rather than ( |31| ) (i.e. the uncertainty of our 
clock) is guaranteed to vanish as iV — > 00. The disorder-averaged generating functional 
is now a path integral: 



(35) 



Accepting the potential technical problems associated with steepest descent integration 
for path-integrals (which here imply additional assumptions on the smoothness of the 
correlation- and response functions), one can adapt the batch procedures, take the limit 
iV — > 00, and find again an effective 'single agent' process: 



q(t) = 9(t) -a alt' R{t,t') (a[q(f), z]) z + Va ij(t) 



d_ 

The retarded self-interaction kernel is given by 

R(t,t')=5(t-t')+J2(-lY(G e )(t,t') 

l>0 



(36) 



(37) 



(i.e. the continuous-time equivalent of the previous [I + G] \ written as a power series), 
whereas the zero-average Gaussian noise rj(t) is here characterized by 

1 



roc 

(v(tHt'))= £(-l) W / ds 1 ...ds £ ds' 1 ...ds' e ,Y[ 

W>0 uv 



1 



V S(s u 



x G(s , s 2 )... G{s e . 1} 8 t )[l + C{s e , s' e ]G\s' e , sU) . . . G\s[, s' ) (38) 

(which would only for 77 = be a continuous-time version of previous expressions). The 
order parameter kernels C and G are to be solved from 

C(t,t') ^ ((a[ q (t),z)) z (a[Q(t'),z)) z ) (39) 
5 



G(t,t') 



59(f) 



(40) 



The closed macroscopic equations for the 

original so-called on-line 

MG with random external information (in the limit iV — > 00) are claimed to be exact 
for any a and any type of decision noise. Although they are again not easily solved in 
general, they have clarified many of the debates and apparent contradictions in previous 
studies. More specifically, they reveal that 
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The ergodic stationary state in the regime a > a c (T), which is calculated easily, 
is independent of rj, and consequently identical to that of the batch MG and the 



replica solution in [11, Q. For a < a c (T), however, this is no longer the case: 
batch and on-line MG dynamics are now truly different. Previous methods had not 
yet succeeded in producing exact macroscopic laws for this regime. 

Premature truncation of the Kramers-Moyal expansion after the diffusion term 
(leading to a Fokker-Planck equation), provided with the correct diffusion matrix 
(i.e. neither of the ones proposed so far), would for iV — > oo have led to the correct 
macroscopic equations. Apparently, the natural order parameters of the problem 
are not sensitive to the weak non-Gaussian fluctuations. 



7. Discussion 



Minority Games are a specific class of disordered stochastic systems without detailed 
balance. In this contribution I have tried to give a (biased) introduction to their 
definitions, properties, and non-equilibrium statistical mechanical theories. I claim that 
the generating functional analysis techniques proposed by De Dominicis j|] (which allow 
for the derivation of exact, closed macroscopic dynamic equations in the limit N — > oo) 
are the canonical tools with which to study these systems, both (a priori) in view of 
the specific nature of the MGs as statistical mechanical systems and (retrospectively) in 
view of the insight and clarification which application of these techniques have already 
generated. Compared to some of the other methods in the disordered systems arena, 
generating functional analysis is immediately seen to be in principle mathematically 
sound. As always in applied areas, one should worry about the existence of limits 
and integrals, but these are quite conventional reservations (in contrast to e.g. replica 
theory); the only serious step is the application of saddle-point arguments in path 
integrals (for the on-line MG), but, again, this is a familiar type of worry in statistical 
mechanics about which much has already been written. 

In addition the generating functional analysis methods have opened the door to 
many interesting new questions which can now start to be addressed. At the level 
of increasing realism, one could re-introduce multiple strategies (S > 2), increase 
the agents' decision range (e.g. to a G { — 1,0,1}, representing the options buy, 
inactivity, or sell), inspect slowly evolving strategy tables, consider the trading of 
multiple commodities, introduce capital and trading costs, etc. This is perhaps not 
likely to generate fundamentally new mathematical puzzles, but would make MGs more 
relevant to those interested in markets as such, and thereby promote the power of non- 
equilibrium statistical mechanics in a wider community. 

At the mathematical level one could now assess the precise impact of replacing the 
true market memory by random numbers in the definition of the external information 
(there is simulation evidence that for a < a c there might be non-negligible differences 
after all). In replica approaches this would be nearly impossible (since it renders the 
model again non-Markovian), but within the generating functional framework (where 
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one already finds a non-Markovian effective 'single agent' anyway) there appear to be 
no fundamental obstacles. Secondly, one could try (for the batch and on-line versions) 
to construct or approximate further solutions of the macroscopic equations in the non- 
ergodic regime a < a c . Thirdly, the generating functional equations reveal that many 
of the approximations which have been used in the past to calculate the volatility a boil 
down to assuming the existence of non-equilibrium Fluctuation-Dissipation Theorems in 
the stationary state. It would be interesting to investigate more generally the existence 
and nature of such identities relating the correlation and response functions for models 
such as the MG, where (in contrast to e.g. spin-glasses) detailed balance violations 
are built-in microscopically, rather than emerging only in the N — > oo limit. Any 
new results concerning such identities would have considerable implications for a wider 
area of non-equilibrium systems, including e.g. non-symmetric neural networks, cellular 
automata, and immune system networks. 
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